View Post [edit]
Poster: | pegzmasta | Date: | Mar 2, 2016 6:50pm |
Forum: | forums | Subject: | 93% of forum links are not pointing to the forums |
<div class="tabby">
<div>
<a id="tabby-forum-finder" class="stealth" href="/details/Collection-Name&tab=forum" onclick="return AJS.tabby(this,'tabby-forum')">
<div class="iconochive-comments tabby-icon" aria-hidden="true">
</div>
<span class="sr-only">comments</span> <span class="hidden-xs-span tabby-text">Forum</span>
</a>
</div></div>
- Announcements
- Bands That Are Pending
- Bands That Have Opted Out
- Bookmobile
- Bookmobile Announcements
- FAQ Forum
- FreeCache
- General Website Discussion
- Macromedia CD-ROM
- Movie Of The Week
- News
- Petabox
- Research Proposals
- SFLan
- The Forum (obviously)
lynx -source https://archive.org/iathreads/forums.php | grep '^[ ]*<tr>.*/details/' |There also exists 10 blank forums listed on the Archive. Sort alphabetically to find them, or list them with a command similar to the following:
sed 's_.*href=.*">\(.*\)</a>.*_\1_' | sort
lynx -source https://archive.org/iathreads/forums.php | grep 'href=""'There exists 212 forums listed on the Internet Archive; 10 of which are blank; 15 of which point to the right place; as well as, 187 of which that do not point to the right place. That means that only 7% of the forum links bring users to the proper destination, while 93% do not. The Wayback Machine Forum requires special attention, though; the one listed on the forums page simply links to the Wayback Machine– not the actual forum page, and no other link can be found on the Archive to get there. I had to use an external search engine, DuckDuckGo, in order to find the Wayback Machine Forum– this is what I mean by extra navigation. Here is a link to the Wayback Machine Forum. The solution has nothing to do with changing the current layout of the Archive, and nothing to do with API's– it's merely a few spelling mistakes in terms of HTML. Since the error is simple, I'm sure the fix will be simple. I welcome your feedback, Michael Pagan E-Mail: mailto:michael.pagan@member.fsf.org Ps: The FAQ still contains an error that has yet to be fixed (it has been identified by at least 2 users, thus far). The error is a duplicate line of text that should be replaced with an appropriate solution to its preceding question. This error can be seen by executing a command similar to the following:
lynx -dump https://archive.org/about/faqs.php | grep -v '^$' | uniq -D
This post was modified by pegzmasta on 2016-03-03 02:50:26
Reply [edit]
Poster: | Jeff Kaplan | Date: | Mar 3, 2016 6:46am |
Forum: | forums | Subject: | Re: 93% of forum links are not pointing to the forums |
Reply [edit]
Poster: | pegzmasta | Date: | Mar 9, 2016 7:29pm |
Forum: | forums | Subject: | Re: 93% of forum links are not pointing to the forums |
[3/21/15, 11:10:12 PM] tracey: ======================== MAJOR archive v2.1 RELEASE ============================ [collection pages]: Major update to how Tabs (eg: [About] [Collection] [Forum]) are done. Now we use/cause CGI-arg changes (not hash/anchors) -- for modern browsers it is dynamic and not a full page load, too! This allows users to bookmark any wanted Tab to be opened on page load, on browser "back" and "fwd", etc. So for example, you can now sort and/or infin scroll to some result set in [Collection] tab, then click on [Forum] tab, then click browser , and you are exactly where you were for modern browsers. (More like this coming in future for sort/facet changes and only reloading parts of pages instead of full page load). Now send clients only set of items they are seeing -- should be a bit faster/less playload and less CSS/JS load. (previously sent all four sets for prior 4 "SORT BY" options, and used JS to toggle unhide whichever sort was wanted).
It is noted here that as of March 21, 2015 @ 11:10:12 PM, that [collection pages] shall no longer use the "hash/anchors." The CGI-arg can be provided automatically once the forum problem affecting the Collections has been solved. Once it's solved, the forums will operate more efficiently and save users more time, since they will no longer be sent to the wrong tab and be required to find a link to the forum (i.e. the comments Forum button). I have not found a bug reporting facility for the Internet Archive; thus, the initial post for this thread is my Bug Report. As a feature request, can we install a Bug Reporting Tool that actively tracks the status of a bug for the Archive's website? This would be a tool that users can use to submit any errors that they find on the website, where they can easily illustrate a problem that can not be solved by the FAQ. Last thing, can we also update the ChangeLog to indicate all the latest changes; the last update was on April of last year– either the Internet Archive has been error-free for almost an entire year OR the file has been neglected. After viewing several forum posts (I won't list them, unless to make a point) identifying errors and seeing admins replying that the changes are under way, this leads me to believe that the file simply needs to be updated. This is important, because the changes indicated in the ChangeLog help to show the progress that the Internet Archive is making– from a technological standpoint. This is the one file that can actively declare which features were added, which bugs were fixed, and more! I've never spoken to tracey before, but after reading this file I can see that she and her team have put in a lot of effort in this site. Let's work together to ensure that the Archive is more responsive now that V2 is almost official! Please keep us updated about the below issues that have been identified via this thread:
- Issue 1– forum links should link to forums
- Issue 2– duplicate lines of text should be fixed in the FAQ
- Issue 3– the ChangeLog should record ALL programmatic changes to the Internet Archive, in order to show progress and to inform users when features were implemented, and when which bugs were fixed
This post was modified by pegzmasta on 2016-03-10 03:29:59
Reply [edit]
Poster: | pegzmasta | Date: | Apr 4, 2016 12:21pm |
Forum: | forums | Subject: | Re: <b><font color="#008000">100%</font></b> of forum links <i>will be</i> pointing to the forums… <b>Problem Solved!</b> |
We love free/libre Movies, E-Books, Music, and all sorts of things. We love Grateful Dead, Old Time Radio, and BitTorrent (sorry if I didn't mention your favourite thing), etc.; however, these things shall always remain relevant and archived. Our very community is slowly degrading through various "improvements"… questions are ignored, whenever it's about a certain something; identified problems remain unsolved, whenever it's about a certain something; finally, while feedback is always constant, development and bugfixes remain at a standstill, whenever it's about a certain something. That certain something is…
Hello there fellow Forumites, and welcome! After witnessing the Forum banner above and recognizing the author of this post: I'm sure you're well aware of what the theme of this post is going to be about, so I won't insult your intelligence by repeating what you already know. What you may not already know, is that the forum problem is a multi-part problem and that it won't be solved in one strike. It will be solved step-by-step… part-by-part. Today, I declare that one of these parts shall be dissolved into nothingness, as I shall have you cast a spell on your web browsers for the sake of the Internet Archive. This will be one of those rare posts where I do not ask any questions. That is, because this post isn't about asking questions: It's about answering them; it's not about ignoring problems: It's about solving them; so, let's answer– let's solve! In order for you to understand how I reached this solution, I must insert you into my train of thought: You see… I got tired of waiting for bugfixes and changes that I knew wasn't coming, so I decided to see if there was software that would allow a fix to be made onto the forums (unlike the magic command I introduced in an earlier post, this would be a convenient, in-browser solution that anyone could apply). If whoever was in charge of making changes to "archive.org" refused to make the changes server-side, then why not simply make the changes client-side… is what I thought! A simple solution that could be applied in merely a tenth of the time than it would take for you to read this post; in at least 5 clicks, and one of the forum problems would be vanquished! Now, I have your attention… This very document that's being served to your web browser is written in HTML; it's style and appearance is dictated via Cascading Style Sheets; these 2 markup languages and the data they govern, themselves, can be manipulated and given functionality via JavaScript… that is the key! Imagine, if you could add in your own custom user script to your browser for whichever website: You could alter Beta (v2) and transform it back into Classic; you could restore The lost village green; and finally, you could fix forum links (today's task). This concept is known as Augmented browsing. It sounds complex, but even a monkey can do it; in fact, we need a monkey in order to utilize this concept… {{ Greasemonkey }} (download and install through the Greasespot homepage). There shall be no flame wars, but I must proclaim: If you use a web browser that is NOT Firefox (might I suggest a {{ a free/libre derivative }} for those who haven't switched, yet) or Chrome, then you are using an inferior browser for viewing the Internet Archive. If you persist in using an inferior web browser, then you'll need to conduct further reading on Cross-browser user scripting (Chrome is the next choice after Firefox and derivatives, and has the highest compatibility for augmenting your web experience; other web browsers may not provide you enough freedom to do such things). Greasemonkey allows you to manage your user scripts– there exists thousands of user scripts that can tailor how you want any specific website to behave and look when you enter it. Today, it's our turn to try, and we'll be using a script called {{ Linx Amender }} (click on the [ Install ] button on that page to add it to Greasemonkey). This script is Free Software– just like Greasemonkey is (extra kudos goes to TimidScript for releasing this user script as Free Software, so we can all use it in freedom), and it will allow us to fix the forum links on the Internet Archive. Once you've installed Greasemonkey and added Lynx Amender to it: Press F9 on your keyboard (this will pull-up the user interface for Lynx Amender); afterwords, select the Online Rules button on the bottom of the interface. Now you'll see a list of rules that has been submitted online for anyone to use. Scroll all the way to the bottom, and you'll find one of the rules that I've submitted to TimidScript: Internet Archive: Fix forum links for archive.org. Click on the "Enabled" button, so that it is now active and coloured green; afterwords, click on the purple "Attrib" button to the right in order to open the forums page in a new tab (you may exit Lynx Amender in the previous tab at this stage). Click on any link, even the Wayback Machine Forum and even the links that I've identified in my initial thread as a "Bad link", and you'll find that they all point to the proper destination. Link efficiency has gone from 3%, all the way up to 100% in one fell-swoop, and will remain that way for as long as you have Greasemonkey and Lynx Amender installed! If this solved the problem for you, be vocal about it and let me know; if you are too reserved and don't know how to reply to this: Simply reply with Problem Solved! Like I said, this only solves part of the forum problem. Stay tuned, and I'll inform you if I find more solutions (or if I manage to create any solutions).
- Click here to install Greasemonkey in Firefox or derivatives; afterwords, restart your browser
- Click here to install Lynx Amender; afterwords, restart your browser
- Press F9 to open the Lynx Amender interface
- Search for the rule titled "Internet Archive: Fix forum links for archive.org"
- Click on "Enabled" to activate the new rule; this button should be green now
- Click on "Attrib" to open the forums page in a new tab
- Enjoy the fixed forums!
EDIT: The forum links are not fixed in the user's library ("My Library"). I've just added a new URL to the rule for Lynx Amender, and TimidScript will be updating it soon (I'll re-edit this post when it is complete). Keep an eye out for the updated post via the Most recent posts link; there will be instructions under "EDIT:" for how to trigger the update. EDIT: The Online Rules for Lynx Amender has been updated to also fix forum links in the user's library. Press "ALT + F9" to trigger Lynx Amender to force an update to the rules it has; you should do this if you applied my solution before this post was updated. The rule will fix forum links whenever you enter from one of the below URL/REGEX's (essentially, all forum links will be fixed no matter where you are located in the Archive– even your user profile):
- ^https://archive.org/post/.*
- ^https://archive.org/details/\@.*
- @https://archive.org/iathreads/forums.php
- ^https://archive.org/iathreads/forum-display.php.*
- ^https://archive.org/search.php\?query=forumPost.*
- ^https://archive.org/iathreads/posts-display-new.php.*
This post was modified by pegzmasta on 2016-04-04 19:21:41
Reply [edit]
Poster: | Jeff Kaplan | Date: | Apr 5, 2016 12:57pm |
Forum: | forums | Subject: | Re: <b><font color="#008000">100%</font></b> of forum links <i>will be</i> pointing to the forums… <b>Problem Solved!</b> |
https://archive.org/iathreads/forums.php
Reply [edit]
Poster: | pegzmasta | Date: | Apr 5, 2016 3:28pm |
Forum: | forums | Subject: | Re: <b><font color="#008000">100%</font></b> of forum links <i>will be</i> pointing to the forums… <b>Problem Solved!</b> |
- Administrator of your own Collection [249 Posts]
- Audio808 Forum [6 Posts]
- Independent News [42 Posts]
- Internet Archive Books [44 Posts]
- Media Arts Forum [1 Post]
- Community Movies Arabic [11 Posts]
- Community Movies Chinese [1 Post]
- Community Movies English [22 Posts]
- Community Movies French [2 Posts]
- Game EPKs Forum [2 Posts]
- Software: Wanted Forum [21 Posts]
- University of Ottawa [1 Post]
- University of Toronto - OISE/UT Library [1 Post]
- World at War Forum [11 Posts]
- zhejiang [2 Posts]
This post was modified by pegzmasta on 2016-04-05 22:28:07
Reply [edit]
Poster: | Jeff Kaplan | Date: | Apr 5, 2016 4:13pm |
Forum: | forums | Subject: | Re: <b><font color="#008000">100%</font></b> of forum links <i>will be</i> pointing to the forums… <b>Problem Solved!</b> |
This post was modified by Jeff Kaplan on 2016-04-05 23:13:48
Reply [edit]
Poster: | pegzmasta | Date: | Apr 5, 2016 5:47pm |
Forum: | forums | Subject: | Re: <b><font color="#008000">100%</font></b> of forum links <i>will be</i> pointing to the forums… <b>Problem Solved!</b> |
This post was modified by pegzmasta on 2016-04-06 00:47:15
Reply [edit]
Poster: | Dupenhagen Moonbat | Date: | Apr 6, 2016 3:00pm |
Forum: | forums | Subject: | You Watch. |
They're the poker player who stubbornly believes you're bluffing, till all his chips are at stake.
It's comic drama at its finest.
Reply [edit]
Poster: | Dupenhagen Moonbat | Date: | Apr 5, 2016 3:38pm |
Forum: | forums | Subject: | *THIS* is How-wid Co-SELL |
Reply [edit]
Poster: | PDpolice | Date: | Apr 4, 2016 12:59pm |
Forum: | forums | Subject: | Re: <b><font color="#008000">100%</font></b> of forum links <i>will be</i> pointing to the forums… <b>Problem Solved!</b> |
Thanks very much.
Reply [edit]
Poster: | PDpolice | Date: | Apr 3, 2016 3:00pm |
Forum: | forums | Subject: | Re: Problem Solved! |
This is fantastic work. And fortunately I already use Firefox. I do perceive a potential problem. Without any real data I would estimate that less than 5 percent of the IA will see or read your forum post. Of that group only a small number will understand and do the work to set things up. Some will misunderstand your work and enthusiasm. And the Archive itself will for show no interest.
Would it be possible for you to set up a page that had the links and updates and upload that page to the Internet Archive? I know you have the skill but may not have the time. It would be humorous if your working page resembled the original format. Don't forget I saved the old intro format.
https://ia601504.us.archive.org/15/items/IAmarch2016/IAmarch2016.htm
Reply [edit]
Poster: | pegzmasta | Date: | Apr 3, 2016 4:28pm |
Forum: | forums | Subject: | Re: Problem Solved! |
This post was modified by pegzmasta on 2016-04-03 23:28:46
Reply [edit]
Poster: | Dupenhagen Moonbat | Date: | Apr 3, 2016 10:05pm |
Forum: | forums | Subject: | Re: Problem Solved! |
This post was modified by Dupenhagen Moonbat on 2016-04-04 05:05:32
Reply [edit]
Poster: | pegzmasta | Date: | Apr 3, 2016 8:01pm |
Forum: | forums | Subject: | Re: Problem Solved! |
This post was modified by pegzmasta on 2016-04-04 03:01:55
Reply [edit]
Poster: | pegzmasta | Date: | Mar 15, 2016 4:07pm |
Forum: | forums | Subject: | <span class="iconochive-warning" style="color:#FF0000;"></span> Re: <b><font color="#FF0000">97%</font></b> of forum links are not pointing to the forums! |
lynx -source https://archive.org/iathreads/forums.php | grep '^[ ]*<tr>.*/[ia].*/' | sed 's_.*href=.*">\(.*\)</a>.*_\1_' | wc -lWhat's strange is that the Archive Statistics (be patient; may take a little while to load) reports that there are 383 forums in the Archive. Too lazy to scroll and find the number? Execute the following command:
lynx -dump https://archive.org/about/stats.php | grep 'Number of forums' | gawk -F': ' '{ print $2 }'213 forums are listed on the forums page; however, the "stats" indicate that there are 170 more forums. Either the "stats" that are auto-generated by the Archive contains a bug that prevents it from counting the forums properly, OR there exists 170 forums that are being hidden from the community. If it's a statistics bug: Can you please fix it by having the statistics report the correct number? If the forums are hidden: Can you please restore the links by adding them back to the forum listing? If there does exist an additional 170 forums on the Archive, that would bump up the number of failed forum links from 93% to 97%– that's almost a 100% failure rate (that's bad). Let's do the math! As identified in my initial post, only 15 forum links currently work in the Internet Archive. The quantity of 15 divided by 213 multiplied by 100, equals 7%. With the newly discovered error: The divisor changes to 383, which gives us a quotient of 0.0391645 (I'm truncating it down to 0.03, for simplicity's sake); multiplying by 100 gives us a product of 3%. That means that only 3% of the forum links bring users to the proper destination, while 97% do not. The point of this post is that the bare minimum amount of forum links that are working (3%) is NOT good enough for the needs of the community that use the Internet Archive everyday in search for answers. We should be striving for 100% efficiency– not 3% efficiency! Don't ignore this post– actually read what I have to say, and please respond. Today is the day of reckoning for certain users now that beta is here, and I'm sure they will vote with their feet. I challenge the Archive to correct these errors and to respond in order to keep our invaluable users, for it is they who make the Internet Archive what it is today– not just the admins who maintain it! Here's a brief eulogy for our soon to be forgotten interface: out with old, in with the new; goodbye Classic Interface, we hardly knew you… On a side note: Thanks for fixing Issue 2 identified in this post.
This post was modified by pegzmasta on 2016-03-15 23:07:52
Reply [edit]
Poster: | PDpolice | Date: | Mar 15, 2016 6:40pm |
Forum: | forums | Subject: | Re: <span class="iconochive-stop" style="color:#FF0001;"></span> Re: <b><font color="#FF0001">Forums are not the forums!</font></b> |
More than likely this good work of yours will be hidden and/or lost to the new version. It is only due to my preparedness that I could find this posting. Based on my view of past IA actions they have little interest in the 'community' outside the GD.
Good luck Don, I know I will miss the 'community' and posts such as yours.
Reply [edit]
Poster: | pegzmasta | Date: | Mar 15, 2016 7:29pm |
Forum: | forums | Subject: | Re: <span class="iconochive-stop" style="color:#FF0001;"></span> Re: <b><font color="#FF0001">Forums are not the forums!</font></b> |
This post was modified by pegzmasta on 2016-03-16 02:29:17